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The Pontryagin Maximum Principle provides a 
powerful theory for determining the optimal control of 
dynamic systems describable by nonlinear differential 
equations with bounded control. When applied to a 
high-order system, the Maximum Principle yields 
much information about the nature of the solution, 
but the actual solution is seldom obtained, because a 
difficult, mixed boundary-value problem is invariably 
encountered. In such instances, the known boundary 
conditions are divided between initial and terminal 
values, and the mapping from the initial to terminal 
boundary values is not, in general, explicitly known. 


Most current computer algorithms which treat this 
problem are based on local-seeking methods and the 
assumption of a single minimum. Such methods are of 
limited value when the hypersurface of the perform- 
ance function being studied is multipeaked or dis- 
continuous. 

To resolve some of these difficulties, a method based 
on random techniques has been devised and used 
successfully. The method is based on an adaptive 
random-search algorithm employing both local and 
global properties to solve the two-point boundary- 
value problem in the Maximum Principle for either 
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fixed or variable end-time problems. The mixed-bound- 
ary-value problem is transformed to an initial-value 
problem, and the required mapping between initial 
and terminal values is constructed with the aid of a 
hybrid computer. 

For simplicity, the essence of the method is illus- 
trated for the fixed-time case. On the left-hand side 
of the figure, the set of equations to be solved which 
result from an application of the Maximum Principle 
is shown. The solution of these equations determines 
the optimal control function which minimizes an 
arbitrary performance function. The complete set 
of boundary conditions for these equations is generally 
not known. On the right-hand side of the figure, the 
algorithm used to determine the unknown initial 
boundary conditions is illustrated. The algorithm is 
based on: ( 1 ) introducing a vector metric which meas- 

ures the vector distance by which the desired terminal 
boundary conditions are not satisfied; and (2) reduc- 
ing this vector metric iteratively by searching for the 
unknown initial boundary conditions from a Gaussian 
probability density function. However, the pure ran- 
dom search is generally unsatisfactory because of ex- 
cessively long convergence times. The convergence 
properties are improved by making the system adap- 
tive by varying the mean M and standard deviation 
<j as a function of the past performance as indicated 
by the adaptive loops and the algorithm logic 
f(£*, £ 2 , £ 3 , J°, J 1 , . . .J k ). Iteration stops when the 
vector metric J is small enough to satisfy the problem 
requirements. 

Several variations of the function f of the algorithm 
were investigated. The most useful characteristic 
given to the function f was based on the notion of a 
creeping, expanding and contracting search. The 
creeping character of the search is provided by varying 
the mean of the distribution to equal the initial condi- 
tion of the adjoint vector on the last successful itera- 
tion. The expansion and contraction character of the 
search is provided by varying the standard deviation 
so that the search is localized when successful, but 
expanded geometrically when not successful. This type 


search has desirable local and global search proper- 
ties; “hanging up” on a local minimum, as with 
gradient methods, is avoided. Furthermore, it will 
not matter if the boundary surface is discontinuous or 
how many peaks or valleys there are. 

The hybrid computer is ideally suited to implement- 
ing the above algorithm. By comparison, an all-digital 
implementation is about 1,000 times slower. The 
requirement for solving the equations of motion a 
large number of times is fulfilled most efficiently on an 
analog device, and the memory and computation 
capability required by the algorithm are best imple- 
mented on a digital device. The amount of apparatus 
required increases linearly with the order of the system. 

The feasibility of the method has been demonstrated 
experimentally on several highly nonlinear systems 
of an order as large as six. 
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